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For a very general class of probability distributions in disordered 
Ising spin systems, in the thermodynamical limit, we prove the follow- 
ing property for overlaps among real replicas. Consider the overlaps 
among s replicas. Add one replica s + 1. Then, the overlap q a , s +i 
between one of the first s replicas, let us say a, and the added s + 1 is 
either independent of the former ones, or it is identical to one of the 
overlaps q a b, with b running among the first s replicas, excluding a. 
Each of these cases has equal probability 1/s. 

1 Introduction 

In this paper we focus on general properties of overlap distributions in 
statistical-mechanical models made up of Ising spins (see below for defi- 
nitions). Historically, these properties have been considered for the first 
time in spin-glass models 0, so that for convenience we take them as a 
starting point in our discussion, and generalise our results later on. 

The problem of finding the phase structure of short-ranged models for 
spin glasses has proved extremely difficult, and yet remains unsolved. An 
important result, though, has been achieved with Parisi's solution of the 
Sherrrington-Kirkpatrick (SK) model (a mean-field approximation to more 
realistic ones), whose hamiltonian we recall: 
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The cjj's (i = 1, . . . ,N) are Ising spins and the Jjfc's (collectively noted J) 
are random variables drawn from independent unit normal distributions, 
with the constraints Jit = Jki and J a = 0. The sum runs over all couples 
(ik), with 1 < i < k < N. Parisi solution for this model implies a countable 
infinity of pure states (below the critical temperature), that turn out to 
be organised in a very remarkable geometric structure, of the type called 
ultrametric Jjj. 

This structure is clearly seen by introducing a replicated system, made 
up of non-interacting, identical copies (replicas) of an SK system. These are 
usually called "real" replicas to distinguish them from the replicas used in 
the replica method, which requires a limit to zero replicas. In this way the 
Boltzmann state of the replicated system is simply the following product 

n J (.) = (Jj ) ®...®J J s) )(.), (2) 

(i) 

where ujj is the state of replica i for a given realisation of the J's. We call 
af the variables associated to replica a, on which Wj' acts. Notice that all 
replicas have the same noise J. We will write E(-) the average over the 
coupling distribution. 

The overlap between the spin configurations of different replicas a and b 
is defined as: 

1 N 

Qah = ^Yl ■ ( 3 ) 

i=l 

Notice that Q aa would be trivially equal to one. We introduce now the 
random variables q a b (referred to also as overlaps) by requiring that for 
any smooth function F S (Q) of the configuration overlaps among s replicas 
(summarised by Q in the notation) the following equality holds: 

nVj(F s (Q))) = (F s (q)) , (4) 

where (•) is by definition the average with respect to the distribution of 
the g's. According to (Q), this implies both Boltzmann and J averages. 
Although the replicas are independent so long as the thermal average is 
considered, they are coupled by the J average, for they all share the same 
realisation of the couplings. In fact the Parisi solution gives the following 
joint distribution for the overlaps qu arid qn among three replicas, labelled 
1, 2, and 3: 

1 1 

Pl2,13Wl2, <7l3) = ^P(qi2)p(qi3) + -/>(<712)%12 ~ Ql3) , (5) 
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where p(-) is the probability distribution of the overlap between any two 
replicas. Formula (|5|) says that the two overlaps are independent with prob- 
ability one half, and identical with the same probability. Even when we 
consider two overlaps between two distinct couples of replicas, the correla- 
tion remains strong: 

2 1 

P12,34(<712, 934) = gP(<7l2)p(<734) + g/>(<7l2)%12 ~ 934 ) • (6) 

The difference with formula (||) is just that the probability of the two over- 
laps being identical has reduced to one third, and accordingly the probability 
of their being independent is two thirdies. 

In general, the underling ultrametric structure allows all joint probability 
distributions of the overlaps among replicas to be expressed as functions of 
the distribution /?(■) of a single overlap. We refer to the literature (?J for 
a thorough exposition of this geometrical structure, but here we want to 
stress the well known fact that this situation requires pj(-), i.e. the overlap 
distribution at fixed J, to be non-self-averaging with respect to J, that is to 
depend on the realisation of the couplings even after the thermodynamical 
limit has been taken. In fact, since p(q) = E(pj(Q)): 

Pl2,34(9l2, 934) = EO Jl2i 3 4 (Qi2, Q34)) 

= HpAQi2)pAQu)) £ HpAQi2))Hpj(Qu)) , (7) 

i.e. p,j{) fluctuates with J. 

While a complete mathematical proof of the Parisi solution is still lack- 
ing, the latter is widely believed to be correct due to extensive computer 
simulations ||, |5| and mathematical arguments, see 11, O, |2| and ref- 



erences therein. On the other hand, doubts about the relevance of the 
ultrametric structure to realistic models have been raised in the last years, 
and in particular the existence of non-self-averaging quantities in the ther- 
modynamical limit has been questioned ||, see however ||. In our opinion, 
since Parisi's method seems very difficult to generalise beyond the mean- 
field approximation, a deeper understanding of the ultrametric geometry in 
the simpler SK model is a necessary first step in order to consider its rele- 
vance to short-ranged models. In this paper, following the ideas outlined in 
P, E|, we are able to prove that some features of the ultrametric geometry 
arise naturally in the SK model as a consequence of the self-averaging of 
thermodynamical quantities, e.g. the internal energy. 

Moreover, by a careful limiting procedure we establish the same results 
for short-ranged models. We do not address the very difficult question of the 
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number of phases in the glassy regime of spin- glass models, but show that, 
whichever this number be, the overlap distributions (as previously defined) 
have some ultrametric features. 

In section two we recall some known results, and find their consequences 
for the overlap distributions in the SK model. In section three we generalise 
these arguments in order to construct a well-defined set of such distributions, 
independently from Parisi's work and in agreement with it. Section four is 
devoted to the extension of these results to short-ranged models. A short 
concluding section summarises our arguments. 



2 Consequences of self-averaging 

For the sake of convenience let us define: 

Aj{<r} = ~Hj{a}. (8) 

We start our arguments by recalling a known theorem, stating the self- 
averaging of Aj{a} with respect to the (•) average in the thermodynamical 
limit 1J: 

lhn o ((Aj{a} 2 )-(A J {a}) 2 )=0. (9) 

By following |||, ||, let us sketch the proof of @. Let us write the (•) 
mean square deviation in (^) as a sum of two terms in the form 

(Aj{a} 2 ) - (Aj{a}) 2 = TEcoj(Aj{a} 2 ) - (TEujj(Aj{a})) 2 = 
m^MAa} 2 ) ~ uJ 2 j(Aj{a})) + (Eu 2 j(Aj{a}) - (TEujj(Aj{a})) 2 ). (10) 

The second term is the E mean square deviation of the internal energy. 



Since Pastur and Scherbina [11] have proven the self-averaging of the free 
energy, standard thermodynamical reasoning based on convexity gives also 
self-averaging for the internal energy i, p. This may fail in principle only 
for a zero measure set of values for (3. Due to the lack of complete control on 
the thermodynamical limit, it is also necessary to exploit subsequences, as 
explained in Q. Therefore, the second term in (|To| ) goes to zero as N — > oo. 
The first term is equal to N~ l dpWiOJj{Aj{a}). Since TEtuj(Aj{a}) is finite, 
the iV _1 term forces also the first term in (pX|) to go to zero as N ^ oo, with 
the possible exclusion of a set of zero measure of values for (3. Therefore we 
have established (||). This, in turn, implies that: 

hm ((Aj{a a }F s (q)) - (Aj{a})(F s (q))) =0, (11) 

N— >oo 
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where by Aj{a a } we intend that ^4j{ct} is calculated on replica a, that we 
take to be one of the replicas in F s (q). This result is achieved from (^) via 
a simple Schwarz inequality: 



lim ((Aj{a a }F s (q)) - (Aj{a})(F s (q))) 2 = 

N—>oc 

hm <(A/K} - (Aj{a})) F s (q)) 2 < 

N^oo 



hm ({Aj{a a } - (Aj{a}))y(F s (q)r = 0, (12) 



by virtue of (||). We express now ([Ll]) in terms of overlaps, using the fact 
that integration by parts gives {Jikf(J)) = (9j ik f(J)), for a generic function 
/(•), since the J's are normally distributed. From this formula we get: 

IE (d Jik nj(F s (Q))) = -±= J2 E (fij(F s (QK4) - fi J (F s (Q))0 J (af^)) 

a= l 

(13) 

by explicit calculation. Applying these formulae, the first term in ( pTT] ) is 
written as: 



(Aj{a a }F s (Q)) = i^El^l^fQ)^^ 



b 

(ik) \ \ b=l 
/ s \ 



Slj{o?o$F t (Q))Slj \Y,° b A 



\b=l 
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J2lab-sqls + ijF s (q)j , (14) 



while the second one is simply: 



(Aj{a})(F s (q)) = ^(l-(q 2 ))(F s (q))- (15) 
Using (0) and (|l5|) in ([□]) we get: 

^Hm (fm ilb - < s+1 - (i - (q 2 ))) ) = ■ (16) 



\6=1 



Since -F s ( - ) is a generic function, we can introduce conditional expectations 
IE (-|^4 S ) with respect to the algebra A s generated by the overlaps among s 
replicas, and write: 



E 



{Q 2 a,s + Ms)=-(q 2 ) + -T,1 2 ab , (17) 



S b+a 
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where the unity in (|l6|) has canceled with the term a = b in the sum. 
We shall leave understood that (17), as others formulae obtained in the 



following, holds exactly only in the thermodynamical limit. 

Using (|I7|) we can write equalities relating averages of squared overlaps, 
the simplest of which is: 

« 3 > = ^ 4 > + ^ 2 > 2 , (18) 

in full agreement with the Parisi probability distribution (||). 

Moreover, from ( |l7| ) we can easily derive an expression for the condi- 
tioned expectation ETq , g +l s+2 |-4.sJ as well, starting by writing (|l7"l) in the 
case of s + 2 replicas and a = s + 1: 

E(g s 2 +1 , s+2 |A+i) = ^Y^ + j^Ei+i' ( 19 ) 

b=l 

Keeping in mind that E (E (-|.A s +i) \A S ) = E (-|>t s ), we have: 

1 I s 
E(d + l,, +2 |A) = —-(q 2 ) + —-J2^{lls + l\A 
S -f- I S ' 6=1 

\ 0=1 c^o 



that is: 

E (d + i lS+2 |A) = ^ T (. 2 ) + E & • (2D 

v ' a<b<s 

From (^) we can derive other known ultrametric equalities, for example: 

(q 2 i2Ql) = \{&) + |<?i 2 2 > 2 , (22) 

again in agreement with (J6|) obtained from Parisi's solution. In the following 
section we generalise formulae (17) and (O) to arbitrary (integer) powers of 
overlaps. 



3 Auxiliary interactions and overlap probability 
distributions 

Let us consider the SK model in the presence of an external field: 

X N 

Aj,A*} d = f A/M + ^£J^ 

i=i 
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a ^ Aj{a} + \Ij,{a}, 



(23) 



where the random variables J- are independt from the Jjfc's and with the 
same distribution. We assume that A is "small", since in the end we will 
take it to zero to recover the free SK model. 

Theorem ( |TT1) can be generalised to the present case, since it only relies 
on self-averaging of the internal energy: 

lim ({Aj,j,{o*}F a (q)) - (Aj,j,{a})(F s (q))) =0, (24) 

N— >oo 

where now (•) implies averaging over the J' variables as well. Using the same 
procedure as in the preceding section, but now integrating and deriving with 
respect to the J' variables, we get the completely analogous formula: 

which continues to hold when A is taken to zero (after having taken the 
thermodynamical limit). The only difference between this formula and (|l7| ) 
is that here overlaps appear at the first power. 

It is now clear that we can consider auxiliary interactions of the general 
form: 

X r I r {a} d = N{x l l)/2 J L-,ir a h---°'ir, ( 26 ) 

(il...ir) 

the former case being r = 1. So we end up with the formula: 

vU s+1 \As)=-(q r ) + -T<l r a b > ( 2 7) 

valid for the free SK model when A r — » 0. A similar formula is valid for 
<?s+i,s+2l-4s) as a generalisation of fl2~I|) . We have thus obtained the 
main result of this paper: 

THEOREM. Given the overlaps among s real replicas, the overlap 
between one of these and an additional replica is either independent of the 
former overlaps or it is identical to one of them, each of these cases having 
probability 1/s: 

p a ,s+i(q a ,s+i\A s ) = ~p(q a , s +i) + -^2 8{q a ,s+i - Qab) , (28) 

S S b+a 



7 



where p a ,s+l('\A s ) is the conditioned distribution of q a ,s+i given the overlaps 
in A s . 

PROOF. The theorem is proved by (27) and the fact that the overlaps 
are bounded. 

COROLLARY: The distribution of q s +i jS +2 conditioned to the overlaps 
in A s is given by: 

2 2 ^ 

Ps+i,s+2(q s +i,s+2\ A s ) = — — -p(qs+i,s+2) + , s 2^ 5(q a +i, s +2 - q a b) ■ 

S+L S( - S + L > a<b<s 

(29) 

PROOF: The proof is the same as that leading from (|l7|) to (|2l|). 



We shall comment on theorems ( P8|) and (29) in the concluding section. 
Notice that the general relations found in the previous theorem imply also 
the constraints on overlap distributions found in Q. 

4 Extension to short-ranged models 

While we have been dealing with the SK model so far, it is easy to establish 
the same results for short-ranged models by carefully taking the thermody- 
namical limit. Suppose that a given model has M pure states at a given 
temperature, that we label uJi(-), i= 1, . . . , M. The value of M is immate- 
rial for our argument (but see the concluding section). Each of these states 
can be reached in the thermodynamical limit by means of a suitable field 
hi, that for disordered systems such as spin-glasses is presently unknown. 

Let us now note TC{cr} the hamiltonian of the considered short-ranged 
model, and let us add to it both the field hi and a perturbation of the SK 
type (p6|) (now written as 'Hsk{o~}), in such a way that the hamiltonian 
becomes: 

H{a} +hi + XHskW} , (30) 

where A is a "small" parameter. 

If, after the thermodynamical limit, A is taken to zero, the system is 
left in the state u)i(-) selected by the field hi, if the SK interaction has been 
kept "small enough" throughout the whole process, and provided that the 
considered model is not unstable with respect to the perturbation TCsk{°~}- 

While A is different from zero, the SK interaction enables us to perform 
the same calculations as shown in the preceding sections, and to establish 



S 



the same relations (^8|) and (^) relatively to the considered states of the 
system. 

In general, we can state that the basic property of the overlaps, given 
by theorem (^), holds for all states that can be reached by adding a small 
spin glass interaction of the type ( |26| ) to the original interaction, by taking 
the infinite volume limit, and then by removing the added spin-glass fields. 



5 Concluding remarks and outlook 

In the preceding sections we have seen how an analysis of fluctuations has 
contributed a deeper understanding of the structure of the SK model, and 
how the same arguments can be extended to general models in statistical 
mechanics. Theorem (p8|) is a strong constraint that all overlap probability 
distributions have to satisfy, but it is not the same as ultrametricity. It 
appears instead to be the same as the hypothesis of "replica equivalence" 



in the framework of the replica method. As Parisi has shown [10], this 
hypothesis enables one to express all joint overlap distributions in terms of 
only those that refer to a complete set of overlaps among each given number 
s of replicas (the simplest case beyond p(-) being /9i2,i3,23( - > •, •) for s = 3). 
Moreover, it can be shown that, under the hypothesis of replica equivalence, 



the only ultrametric solution is the usual Parisi solution |10[, and the same 



conclusion remains true if one starts from (28) instead that from replica 
equivalence. 

The fact that theorems ( |28|) and (^9|) hold for basically all statistical 
mechanical models, compels us to remind that their consequences can be 
trivial, when a particular model is considered. This happens, for example, 
in the high temperature regime, when all overlaps take a constant value. 

As stated in the introduction, the question of what case applies to short- 
ranged spin glass models still stays open. 



Acknowledgments 

We acknowledge useful conversations with Pierluigi Contucci, Charles New- 
man, Giorgio Parisi, Leonid Pastur, Masha Shcherbina, Michel Talagrand. 



9 



References 



[1] M. Aizenman and P. Contucci, On the stability of the quenched state 
in mean field spin glass models, To appear on J. Stat. Phys., available 



as |cond-mat/9712129| , 1997 



[2] A. Bovier and P. Picco (eds.), Mathematical aspects of spin glasses and 
neural networks, Progress in Probability, vol. 41, Birkauser, Boston, 
1997. 

[3] S. Ghirlanda, Sulle proprietd ultrametriche degli stati di sistemi disor- 
dinati, Thesis at Universita di Roma "La Sapienza" (in Italian), De- 
cember 1996. 

[4] F. Guerra, About the overlap distribution in mean field spin- glass 
model, Int. J. Mod. Phys. BIO (1996), 1675-1684, Also available as 
[http: / / romagtc.romal .infn.it / papers /lavori / umezawa.ps . 



[5] D. Ihiguez, E. Marinari, G. Parisi, and J. J. Ruiz-Lorenzo, 3D spin glass 
and 2D ferromagnetic XY model: a comparison, J. Phys. A30 (1997), 
7337, also available as |cond-mat /9707050| . 

[6] E. Marinari, G. Parisi, F. Ritort, and J. J. Ruiz-Lorenzo, Numerical 
evidence for spontaneously broken replica symmetry in 3D spin glasses,, 
Phys. Rev. Lett. 76 (1996), 843, also available as bond-mat/9508036; . 

[7] M. Mezard, G. Parisi, and M. A. Virasoro, Spin glass theory and beyond, 
World Scientific, Singapore, 1987. 

[8] C. M. Newman and D. L. Stein, Non-mean-field behavior of realistic 
spin glasses, Phys. Rev. Lett. 76 (1996), 515. 

[9] G. Parisi, Recent rigorous results support the predictions of sponta- 
neously broken replica symmetry for realistic spin glasses, Available as 



cond-math/9303101| , 1996. 



[10] G. Parisi, On the probabilistic formulation of the replica approach to 



spin glasses, available as cond-mat /9801081 , 1998 



[11] L. Pastur and M. Shcherbina, The absence of self-averaging of the or- 
der parameter in the Sherrington- Kirkpatrick model, J. Stat. Phys 62 
(1992), 1. 



10 



[12] M. Shcherbina, On the replica symmetric solution for the Sherrington- 
Kirkpatrick model, Helv. Phys. Acta 70 (1997), 838-853. 

[13] M. Talagrand, The Sherrington Kirkpatrick model: a challenge for 
mathematicians, Probability and Related Fields 110 (1998), 109-176. 



11 



